Possible Laws for Artificial Life Evolution 
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Motivated by a recent article on open problems in artificial life, here I postulate three laws which 
form a mathematical framework to describe artificial life evolutionary dynamics. They are based 
on a continuous approximation of population dynamics. Four dynamical elements are required in 
this formulation: ascendant matrix, transverse matrix, fitness function, and the stochastic drive. 
The first law states that in the absence of stochastic drive the artificial life always seeks for a local 
fitness attractor and stay there. It gives the reference point to discuss the general evolutionary 
dynamics. The second law is explicitly expressed in a unique form of stochcistic differential equation 
with all four dynamical elements. The third law defines the relationship between the focused level 
of description to its lower and higher ones, and also defines the dichotomy of deterministic and 
stochastic drives. These laws provide a coherence framework to discuss several current problems, 
such as emergency and stability. In particular, two quantities are emphasized: the fitness function 
as the standard for selection and the stochasticity as the source of creativity. Those three laws may 
appear almost self-evident from a statistical physics point of view. However, their equivalent to a 
most conventional approach for evolutionary dynamics is shown for the first time by the present 
author, to the best of his knowledge. The computational advantage of the present formulation in 
the study of artificial life evolution is also discussed. 



I. INTRODUCTION 

In a provocative article jointly published by Bedau et 
al} , fourteen open problems are formulated to indicate 
long term research directions in Artificial Life research. 
They consist of problems to address three types of gen- 
eral concerns. The first type is to explore the relationship 
between real biological life and its material constituents, 
that the relationship between biological and physical sci- 
ences. The second type is to find the quantitative descrip- 
tions of the conditions and potentials for living systems. 
The third type is on consciousness and culture in the 
context of living systems. Those problems provide a very 
comprehensive framework for forming research programs 
and they echo fundamental questions raised previously^. 
Specifically, the 8th problem has been stated as follows: 
Create a formal framework for synthesizing dynamical 
hierarchies at all scales. 

The present article is an attempt to address the 8th 
open question in Ref. [1]. It may also be relevant to ad- 
dress several other relevant quantitative open questions. 
Previous attempts have been made^ to address the 8th 
question. Furthermore, there have been extensive litera- 
ture on it^'^. Such a fundamental question has also been 
raised and the constraints for possible solutions have been 
discussed^"^. Given above consideration, the author be- 
lieves that the present approach differs from those previ- 
ously in the following aspects: It is more abstract, more 
quantitative, and more hierarchical. 

The present mathematical approach is based on the 
continuous approximation which treats the populations 
as continuous variables. This approximation has been 
well studied in physical sciences^ as well as in artifi- 
cial life^. Apart from a discussion on the connection of 
present approach to the genetic algorithm, this approxi- 



mation will not be elaborated further. This implies that 
the equations to be discussed are of differential equation 
type. To be more precise, I will postulate three laws for 
evolution, and the most important law, the second law, 
will be expressed in a unique form of stochastic differen- 
tial equation. The critical component for the broad scope 
application of those three laws lies in the explicit demon- 
stration of the equivalence between those three laws and 
a most general conventional approach to the evolutionary 
dynamics. 

Two quantities are emphasized in the present formu- 
lation. The first one is the fitness landscape. A scalar 
nonlinear function, fitness function, is introduced to de- 
scribe it. Though its usage has a long history, but the 
fitness function dose not appear to occupy a prominent 
position in current theoretical formulations^"'^"'^, and its 
meaning in evolution has been frequently questioned^. 
This might be partially due to the well-known failure to 
find potential in neural network computation for general 
asymmetric nets, such as in cases of limit cycles"'^^. I will 
present an explicit demonstration of how to construct a 
potential, the fitness function, below. I will argue that 
this fitness function is needed in any evolution, as long 
as there is a selection: Fitness function is the standard 
for selection. 

The second quantity is the stochasticity. It is the 
source for innovation, creation and surprise, and for 
breaking down the curse of determinism. I will show 
that in its absence the evolution will be stuck to local 
attractor and will not be able to move to another attrac- 
tor, regardless it would be better or worse. Its impor- 
tance has been indeed emphasized in the study of Arti- 
ficial Lifc"'^'^'^^. Nevertheless, in some approaches to evo- 
lutionary dynamics, its importance seems not to be fully 
appreciated^^. In the present formulation, the impor- 
tance of stochasticity will be formulated in a particular 



transparent manner: It is the engine of evolution. 

I organize the rest of article as follows. In section II 
I postulate and discuss the three laws of evolution. The 
most important law is the second. In section III the con- 
nection of the postulated three laws to previous formula- 
tions is discussed. This section lays down the foundation 
for the generality of the three laws proposed in section 
II. An explicit computation of this connection is demon- 
strated in section IV. I also discuss the compatibility of 
present formulation with an interesting speciation model. 
The implications of present formulation were discussed in 
section V. In particular, its computational advantage is 
pointed out. I conclude in section VI. 



II. LAWS FOR ARTIFICIAL LIFE EVOLUTION 

In this section I postulate and discuss three laws of evo- 
lution. They form a quantitative mathematical frame- 
work for evolutionary dynamics, with four dynamical el- 
ements. Then I discuss a fundamental theorem of evolu- 
tion. 



A. First Law 

The first law is a statement when there is no stochas- 
tic drive in the evolution. This law connects the semi- 
positive definite symmetric ascendant matrix A, anti- 
symmetric transverse matrix T, and the scalar function 
of fitness function ^p in the following mathematical equa- 
tion: 



[A(qt,i)+T(qt,t)]qt=V^(qt,i) 



(1) 



Here I have considered an n component artificial life 
system. The n components may be the species^'*, or 
the traits to describe the speciation^^ , or any quanti- 
ties required to specify the system. The value of j*'* 
component is denoted by Qj. The n dimensional vec- 
tor q"^ = (gi, (72, ..., 9n) is the state variable of the sys- 
tem. Here the superscript r denotes the transpose. 
The dynamics of state variable is described by its speed 
qt = d(\t/dt moving in the state space. To ensure the in- 
dependence of the dynamics of each component, I assume 
det[A(q, t) -I- T(q, t)] ^ 0. Here the subscript t denotes 
that the state variable is a function of time and V is the 
gradient operator in the state space. 

The anti-symmetric matrix permits 'no change': 
qj'r(qi,t)qi = 0, therefore conservative. Dynamically 
it will not change the fitness. A manifestation of the 
transverse dynamics is the oscillatory behavior. It is re- 
quired by the consistency of present mathematical for- 
mulation to account for the asymmetric nature of general 
evolutionary dynamics. The physical analogous may be 
the mass in Newtonian dynamics, where the oscillation 
of a pendulum is guaranteed by the conservation of en- 
ergy: sum of kinetic and potential energies, or, the vector 



potential in electrodynamics needed for electromagnetic 
waves. 

Because of the ascendant matrix A is non-negative, the 
system will approach the nearby attractor determined by 
its initial condition, and stay there forever. Specifically, 
because qJ'A(qf,i)qi > and qj'r(qi,t)q4 = 0, Eq.(l) 
leads to 



qfVV'(qt,i)>0 



(2) 



This equation implies that the deterministic dynamics 
cannot decrease the fitness: The speed of state variable 
qj is in the same direction of the gradient of the fitness 
function V'0(qi,t). If the ascendant matrix is positive 
definite, i.e. qJ'A(q(,i)qt > for any nonzero qt, the 
fitness of the system always increases. Hence, the first 
law clearly states that the system has the ability to find 
the local fitness peak determined by the initial condition. 

I have one remark. From the mathematical theory of 
dynamical systems, there are in general three kinds of 
attractors^^: point, periodic, and chaotic (strange). The 
point attractors have been well explored in biological life 
evolution since the work of Wright^^, corresponding the 
fitness peaks. Other two kinds of attractors have also 
been observed in biology^*'^^. The content of the first 
law has been fully discussed in a recent review of evolu- 
tionary game dynamics in a different approach^ ^, whose 
connection to the first law will be clear in next section. I 
emphasize that there is no connection between different 
attractors in the first law. 

The tendency implied in Eq.(l) to approach an at- 
tractor, represented by the nonnegative ascendant matrix 
which is similar to the friction in mechanics, and to re- 
main there has been amply discussed by Aristotle. This 
law gives a reference point to define species and other rel- 
evant quantities in a clean manner, if stochasticity could 
be ignored. 



B. Second Law 

The central question arises that how does one describe 
the evolutionary dynamics quantitatively and generally? 

I postulate that the dynamics of the system is gov- 
erned by following special form of stochastic differential 
equation, which consists of four dynamical elements, the 
semi-positive definite symmetric ascendant matrix A, the 
anti-symmetric transverse matrix T, the scalar function 
called fitness function if), and the stochastic drive ^: 

[A(q,, i) + T(qt, t)]iit = V7A(qt, t) + ^(qt, i) , (3) 

and supplemented by the following relationship: 

(e(qt,t)r(qt',i')>=2A(q,,t)e<5(t-t'), (4) 

and (^(qt, i)) = 0. The connection of these two equations 
to conventional approaches will be discussed in next sec- 
tion. In Eq.(4) I have assumed the stochastic drive is 



Gaussian with zero mean. Factor 2 is a convention choice 
for the present formulation, and e is a positive numeri- 
cal constant, which for many situations might be set to 
be unity, e = 1, without affecting the artificial life de- 
scription. The relationship between the stochastic drive 
and the ascendant matrix expressed by Eq.(4) guaran- 
tees that the ascendant A{qt,t) is semi-positive definite 
and symmetric. The average (...) is carried over the dy- 
namics of the stochastic drive, and 6(t) is the Dirac delta 
function. 

The dynamical effect of the stochastic drive ^(qt,t) 
on fitness is random: It may either increase or decrease 
the fitness. With above interpretation, the static effect 
natural selection is represented by the gradient of fitness 
function, 'Vi/j{qt,t)- The clear and graphical discussion 
of such fitness function was first given by Wright in the 
discussion of biological life evolution^^. The tempo of 
national selection is represented by the ascendant and 
transverse matrices. Eq.(3) states that the gradient of 
fitness, the stochastic drive, the ascendant dynamics, and 
the transverse dynamics, must be balanced to generate 
the evolution dynamics. 

The fitness function ip is similar to a potential: It is in 
fact opposite in sign to the typical potential energy used 
in physics and chemistry. If it is further independent of 
time and is bounded above, the stationary distribution 
function p(q, t = oo) for the state variable, the proba- 
bility density to find the system at q in state space, is 
expected to be a Boltzmann-Gibbs distribution: 



p{fl,t 



1 



■ exp 



^(q) 



(5) 



with Z ~ J (i"qexp {■0(q)/e} the partition function, the 
integration over whole state space. Its justification will 
be given in next section. It is interesting to note that 
the dynamical aspects of evolution, the transverse and 
the ascendant matrices, do not explicitly show up in 
Eq.(5). This equation implies that the larger the con- 
stant e is, the wider the equilibrium distribution would 
be, and more variation would be, or, the smaller the e 
is, the narrower the distribution. In this sense e may 
be called the evolution hotness constant. The existence 
of such a Boltzmann-Gibbs type distribution suggests a 
global optimization. 

There are a few immediate and interesting conclusions 
to be drawn here. Near a fitness peak, say at q = qpeafe, 
I may expand the fitness function, V'(q) = V'(qpeafe) — 
(q - <lpeakyU{q - qpeafe)/2 + 0(|q - qpeafcP). Here U 
is a positive definite symmetric matrix as a consequence 
at the fitness peak. The stationary probability density 
to find the system near this peak is of a typical Gaussian 
distribution: 



p(q, t — oo) ex exp 



(q-qpeafc)^?^(q-qpe 

2e 



Thus, away from the fitness peak, the probability to find 
the system will be exponentially small. 

One may then wonder about how does the system move 
from one fitness peak to another? This process was first 
visualized by Wright^^. The relevant mathematical cal- 
culation seems to be first done by Kramers^^, where it 
was shown that the stochastic drive must be involved. 
Quantitatively, the hopping from one peak to another 
must be aided by the stochastic drive. The dominant 
factor in the hopping rate T is the difference in fitness 
between the peak and the highest point (saddle point 
(Isaddie) to cross the valley to another peak^"'^: 



r (x exp 



tpiUpeak) - V'(qsadd/e) 



(7) 



(6) 



This rate can easily be exponentially small. It is a quanti- 
tative measure of robustness and stability. Hence it may 
explain the usual observation, for example, that species 
is rather stable if viewing the peak as a definition for 
species. Nevertheless, Eq.(7) grants the possibility to 
hop between peaks when the stochastic drive is finite. 

The second law clearly expresses that the evolutionary 
dynamics is probability in nature, has the ascendancy to 
large fitness in the adaptive landscape. 



C. Third Law 

The third law is a relationship law. It allows the defi- 
nition of the connection of the current level of description 
to its lower and higher ones. It is a reflection of the hi- 
erarchical structure of the whole dynamics. The most 
important feature is that it acknowledges the existence 
of two time scales: micro and macro. 

Specifically, it may be stated as follows: The fitness 
function V'(qj t) has the contribution from lower level in 
terms of time average on the time scale of current level, 
the contribution from the interaction among various com- 
ponents of the current level, and the contribution from 
higher level. The stochastic drive ^(q, t) is the remainder 
of all those contributions whose dynamics is fast on the 
time scale of current focus. Hence its average in time 
is zero. This stochastic contribution may be either un- 
known from a more fundamental level or unnecessary to 
be specified in details. Its probability distribution is ap- 
proximated by a Gaussian distribution in the present ar- 
ticle. The stochastic drive determines the ascendant ma- 
trix A{q,t), and the transverse matrix T(q, i) should be 
further determined by the dynamics of the system. 

The lower level contribution to fitness function ip{q_, t) 
and stochastic drive ^(q, t) may allow the computation 
of the intrinsic fitness landscape and the intrinsic source 
of evolution. However, this contribution tends to neglect 
the horizontal interaction among different components, 
which is usually nonlinear. On the other hand, the same 
and higher level contributions may suggest that a con- 
trol mechanism, such as a feedback, may be from both of 



them in a large perspective. The combination of all three 
of them suggests that the evolution is nonlinear, asym- 
metric, mutually interactive, and stochastic, and may be 
controllable. 

Such a hierarchical structure of artificial evolution has 
been extensively discussed^. There is, however, a degree 
of uncertainty and arbitrariness in the assignment of dif- 
ferent levels of descriptions and the dichotomy of deter- 
ministic and stochastic terms in Eq.(3). This dilemma 
has been amply discussed in physical sciences^. The 
present way to solve this problem will be proposed in 
next section in connection to usual dynamics. 



D. Fundamental Theorem of Evolution 

As implied in the first law, the ascendancy of the sys- 
tem is described by the ascendant matrix A, which in 
turn is completely determined by the stochastic drive ac- 
cording to the stochasticity- ascendancy relation, Eq.(4). 
The discussion followed Eq.(7) indicates that the ability 
of system to find a better fitness peak, no only the local 
fitness peak, or, to reach the global equilibrium, is guar- 
anteed by the stochastic drive. This suggests that Eq.(4) 
is a statement on the unification of the two completely 
opposite tendencies: adaptation and randomization. 

A relation similar to Eq.(4) was also recognized long 
ago by Fisher in the biological life evolution^ ^, called fun- 
damental theorem of natural selection. Eq.(4) may be 
called the fundamental theorem of evolution: It is in- 
dependent of the fitness function but is the engine for 
evolution. 



III. CONVENTIONAL FORMULATION 

A. Standard Stochastic Differential Equation 

Now I make the connection between the dynamics de- 
scribed by Eq.(3) and (4) to the dynamical equations 
typically encountered in evolution. I start with the stan- 
dard stochastic differential equation: 



qt=f(qt,i)+C(qt,i) 



(8) 



Here f (q, t) is the deterministic nonlinear drive of the sys- 
tem, which includes effects from both other components 
and itself, and the stochastic drive is C(q, t), which differs 
from that in Eq. (3) but is governed by the same dynam- 
ics. For simplicity I will assume that f is a smooth func- 
tion whenever needed. The importance and generality 
of such an equation has been known in evolution^^'^^'^^ 
and its special limit of zero stochasticity in the context 
of evolutionary game dynamics was reviewed recently^^. 
The stochastic drive in Eq.(8) is assumed to be Gaus- 
sian and white with the variance. 



and zero mean, (C(qt,0) = 0- Again here (...) indicates 
the average with respect to the dynamics of the stochas- 
tic drive. According to the physical science convention 
the semi-positive definite symmetric matrix D = {Dij} 
with i,j = l,2,...,n is the diffusion matrix. Both the 
divergence and the skew matrix of the nonlinear drive f 
are in general non-zero: 



V-f7^0, Vxf^O 



(10) 



Here the divergence is explicitly V • f = X]?=i '^fj/^^j ~ 
tr{F), and the skew matrix V x f is twice the anti- 
symmetric part of the selection matrix S: (V x f)ij = 



S. 



j« 



Sij with Sij 



dh/dqj 



,3 



1,2,, 



The 



non-zero of the divergence leads to that the state space 
volume is not conserved: Ascendancy is implied. The 
non-zero of the skew matrix, or the asymmetry of the se- 
lection matrix S, implies the existence of the transverse 
matrix T. 

Now, I give an explicit construction which demon- 
strates the existence and uniqueness connection between 
Eqs. (3,4) and Eqs. (8,9). Assuming that both Eq.(3) 
and (8) describe the same dynamics. The speed q^ is 
then the same in both equations. The connection from 
Eq.(3) to (8) is straightforward: Multiplying both sides 
of Eq.(3) by [A{(it,t) + T{(it,t)]-^ leads to Eq.(8). The 
procedure from Eq.(8) to (3) is mathematically more in- 
volved. 

Using Eq.(8) to ehminate the speed in Eq.(3), and 
noticing that the dynamics of noise and the state variable 
behave independently, I have 



and 



[A{q, t) + T(q, i)]f (q, t) = V^(q, t) , (11) 



[A(q,i)+T(q,i)]C(q,t)=e(q,i)- (12) 



Here I have dropped the subscript t for the state variable, 
because time t is now a parameter. Those two equations 
suggest a rotation in state space. 

Multiplying Eq.(12) by its transpose on each side and 
carrying out the average over stochastic drive, I have 



[A(q, t) + T(q, t)]I?(q, t) [A(q, t) - r(q, t)] 



A(q,t). 
(13) 



In obtaining Eq.(13) I have also used Eq.(4) and (9). 
Eq.(13) suggests a duality between the standard stochas- 
tic differential equations and Eq.(3): A large ascendant 
matrix implies a small diffusion matrix. It is a general- 
ization of the Einstein relation for T = case^'^. 
Next I define an auxiliary matrix function 



G(q,t) = [A(q,t)+r(q,t)] 



(14) 



Here the inversion '—1' is with respect to the matrix. 
Using the property of the fitness function -0: V x VV' = 



(C(qt, i)r(qt' , t')) = 2D{(it,t) e 6{t - t'), (9) [(V x V^),, = (V,V, - V,V,)V' ], Eq.(ll) leads to 



V X [G-if(q)] = , 



(15) 



which gives n{n — l)/2 conditions. The generahzed Ein- 
stein relation, Eq.(13), leads to the following equation 



G + C = 2D 



(16) 



which readily determines the symmetric part of the aux- 
iliary matrix G, another n(n+ 1)/ conditions. The aux- 
iliary function may be formally solved as an iteration in 
gradient expansion: 



ith Q 



G = D + 
linio 



(17) 



AG,, 



AG,- 



EZii-^y[(^")D3S-^ + iS^)-'DjS^],Do^DS-S^D, 
D,>i ^ {D + AGj_i) {[V X (£)-! + AG7_\)]f} {D - 
AGj_i). At each step of solving for AG, only linear 
algebraic equation is involved. One can verify that the 
matrix Q is anti-symmetric. For a simple case a formal 
solution of such algebraic equation was given in^**, and 
an explicitly procedure was found for generic cases in^^. 
Eq.(17) is a result of local approximation: If the selction 
matrix 5*, the diffusion matrix D are constant in space, 
the exact solution only contains the lowest order contri- 
bution in gradient expansion: Q ~ AG, ~ AGq. I regard 
Eq.(17) as the artificial life solution to Eq.(15) and (16), 
because it preserves all the fixed points of deterministic 
drive f. The connection from Eq.(8) to (3) is therefore 
uniquely determined: 



V(q,i) = /^dq'-[G-l(q')f(q')] 
A{q,t) = [G-i(q) + (G-)-i(q)]/2 
T{q,t) = [G-i(q)-(G-)-i(q)]/2 



(18) 



Here the sufficient condition det{A + T) 7^ is used, and 
the end and initial points of the integration contour G 
are q and qo respectively. The construction of fitness 
function and other quantities from the conventional ap- 
proach, summarized in Eq.(18), appears to be given for 
the first time by the present author. 

The always existence of the fitness function and the 
associated ascendant matrix and transverse matrix may 
be understood in the follow way. After all, in the evo- 
lution of Artificial Life, a selection must be made. It 
could be purposely, or, determined by the available con- 
dition. If there would be no selection, that is, everything 
would have an equal probability, there would be no evo- 
lution. The fitness function is simply a reflection of this 
fact, and the no selection case is a constant fitness func- 
tion everywhere in the phase space. No structure would 
be expected in this case. The stochasticity links to as- 
cendant matrix by the stochascitiy-ascendance relation 
or the fundamental theorem of evolution. It is a remark- 
able unification on the two apparent opposite tendencies. 
However, there are situations that a selection would not 
affect the total fitness. The transverse matrix reflects 
this dynamical conservation of fitness. 

I should point out that in the absence of stochastic 
drive, i.e., e = in Eq.(4) and (9), above connection 
remains unchanged. 



B. Fokker-Planck Equation 

In many experimental studies in biological life evolu- 
tion, a question is often asked on the distribution of the 
state variable as a function of time instead of focusing 
on the individual trajectory of the system. This implies 
that either there is an ensemble of identical systems or 
repetitive experiments are carried out. To describe this 
situation, I need a dynamical equation for the distribu- 
tion function in the phase space. This goal can be ac- 
complished by the so-called Fokker-Planck equation, or 
the difussion equation®. 

In this subsection, another procedure to find the equa- 
tion for distribution function is presented. It is natural 
from a theoretical physics point. This procedure will es- 
tablish that the fitness function tp in Eq.(l) indeed plays 
the role of potential energy in the manner envisioned by 
Wright, and the steady state distribution will be indeed 
given by Eq.(3). The present starting point will be the 
second law, Eq.(l), not the standard stochastic differen- 
tial equation, Eq.(8), from which most previous deriva- 
tions started. 

The existence of both the deterministic and the 
stochastic drives in Eq.(3) suggests that there are two 
well separated time scales in the system: the microscopic 
or fine time scale to describe the stochastic drive and 
the macroscopic or course time scale to describe the sys- 
tem motion. The former time scale is much smaller than 
the latter. This separation of time scales further sug- 
gests that the macroscopic motion of the system has an 
" inertial" : it cannot response instantaneously to the mi- 
croscopic motion. To capture this feature, I introduce a 
small constant inertial "mass" m and a kinetic momen- 
tum vector p for the system. The state space is then 
enlarged: It is now a 2n-dimensional space. The dynam- 
ical equation for the system takes the form: 



qt = pt/m 



(19) 



which defines the kinetic momentum, and 

Pt = -[A{qt,t) + T{qt,t)]pt/m + Vi/.(qt, t) + ^{qt,t) , 

(20) 

which is the extension of Eq.(3). I note that there is 
no dependent of ascendant matrix A and the stochastic 
drive on the kinetic momentum p. The Fokker-Planck 
equation in this enlarged state space can be immediately 
obtained®: 



{«. 



• Va + f • V, 



K^ 



m 



Vr 



}p{(l,P,t) =0. 
(21) 



Here f — p'^T/m + Wqtp, and t, q, and p are independent 
variables. The subscripts in the d and V indicate the dif- 
ferentiation with respect to indicated variable only. The 
stationary distribution can be found, when the fitness 
function is time-independent and bounded above, as® 



p(q, p,t = oo) = — cxp 



p^/2to — V-'(q) 



(22) 



VV'(q)=I?-'(q)f(q) 



(28) 



with Z = /(i"q(i"pexp{— [p^/2m — ■0(q)]/e} the par- 
tition function. There is an explicit separation of state 
variable and its kinetic momentum in Eq.(22). The elim- 
ination of the momentum in the small mass limit will not 
affect this distribution. Hence, Eq.(22) confirms that the 
expected Boltzmann-Gibbs distribution, Eq.(5) from the 
Eq.(3) and (4), is the right choice. 

I proceed to outline the procedure to find the Fokker- 
Planck equation corresponding to Eq.(3) and (4) without 
the kinetic momentum p. I first illustrate how to recover 
Eq.(3) from Eq.(19) and (20). In the limit of m ^ 0, the 
fast dynamics of kinetic momentum pt can always follows 
the motion of slow dynamics of state variable q^ . Hence 
I may set pi = in Eq.(20) and replace the kinetic mo- 
mentum using Eq.(19), which is then Eq.(3) after moving 
the speed to the left-side of equation. For the Fokker- 
Planck equation, the explicit separation of the kinetic 
momentum and state variable in the stationary distribu- 
tion gives the guidance on the procedure: The resulting 
Fokker-Planck equation must be able to reproduce this 
feature. The Fokker-Planck equation is then found as 

dtp{q, t) - V^[-f (q) - Af (q) + i?(q)V]p(q, t) , (23) 

with Af the solution of the equation V- Af-|- Af • V^ — V- 
[GTG^Vil)] — 0. If the probability current density is de- 
fined as j(q,i) = (f + Af-DV)p(q,t), the Fokker-Planck 
equation is a statement of the probability continuity: 



5tp(q,t)+V-j(q,f)=0 



(24) 



The stationary state corresponds to the condition V • 
j(q, t = oo) = 0. One may verify that the stationary 
distribution /^(q, t = oo) in Eq.(3) is indeed the time 
independent solution of the Fokker-Planck equation: The 
stationary probability current 

j(q, t^^)^ {GTG^ + Af )V^(q) p(q, t = «.) , (25) 

and V • j(q, f = oo) = 0. 

C. Detailed Balance Condition 

There is an important class of evolution dynamics in 
which the anti-symmetric matrix Q = 0. Under this 
condition, the transverse matrix T — 0, and Af — 0. 
The Fokker-Planck equation becomes 



dtp{(l, t) = V"[-f (q)) + Z?(q)V]p(q, t) 



(26) 



and the stationary probability current is everywhere zero 
in state phase: 



j(q,t = oo) =0. 
In this situation one may find that 



(27) 



and A ~ D^^ . The fitness function and the connection 
between Eq.(3) and the standard stochastic differential 
equation Eq.(8) can be directly read out from equations. 
This is the well-known symmetric dynamics in physical 
sciences*. This zero probability current condition is usu- 
ally called the detailed balance condition. 



IV. EXAMPLES 

In this section I discuss two examples. The first one 
is of predator-prey model like. In this model I illustrate 
how to approximately compute the fitness function -0, 
the ascendant matrix A and the transverse matrix T, 
that is, how to make the connection between the conven- 
tional formulation and Eq.(3) and (4). Second example 
is a current model in biological life evolution. It will be 
demonstrated that it can be discussed within the present 
mathematical formulation. 



A. Predator-Prey Model 

The example whose dynamical equation is in the form 
of standard stochastic differential equation is the generic 
predator-prey process. Under the diffusion approxima- 
tion, both the diffusion matrix D and the deterministic 
drive can be obtained from the master equation. The 
diffusion approximation is valid when a large number of 
birth and death events occurs on the macroscopic time 
scale*. 

I now give an explicit demonstration of how to obtain 
Eq.(3) from Eq.(8) for a two component case. Here qi and 
(72 represent numbers of two species in a habitat. I assume 
the spatial distribution is uniform. The deterministic 
drive f consists of two positive terms, birth and death: 



.A(q) = /j6(q) - .f»d(q) « = i, 2 



(29) 



with the subscripts b and d stand for the birth and 
death respectively. Under the diffusion approximation, 
the stochastic drive is* 

G(q, t) = /Mq)Op(i) + y^lMQdit) « = 1, 2 , (30) 

with C,ip{t), Cid{t) arc unity random variables and possible 
correlation among them. Therefore the diffusion matrix 
D can be readily obtained, which is what needed below. I 
remark that the equation similar to predator-prey equa- 
tion has been emerged in the study of the robustness of 
the gene regulatory network of phage A^^ . 

The construction of Eq.(3) from Eq.(8) will be given to 
the lowest order in the gradient expansion. The useful- 
ness of this approximated construction can be illustrated 
for following two reasons. First, in many practical appli- 
cations, lowest order approximation is already enough^®. 



because it is exact in the strictly linear case. Second, sev- 
eral salient features of the connection becomes apparent 
without undue mathematical complications. An impor- 
tant quantity is the selection matrix S. According to the 
definition following Eq.(13), 

Sll = Vl/l , 5*12 = V2/1 , ^l = V1/2 , 5*22 = V2/2 • 

(31) 

Eq.(lO) will not change under the gradient approxima- 
tion. In the lowest order gradient approximation, Eq.(9) 
becomes simple. I collect them here: 



GS^-SG^ ^ 
G + G^ = D 



(32) 



In two dimensions the matrix manipulation is particu- 
larly straightforward. I note that any 2x2 matrix M 
can uniquely decomposed in terms of Pauli matrices, ai 
with i = 1, 2, 3, and the identical matrix 1: 

M = MiCTi + M2cr2 + M^a^ + tr{M)/2 1 , 



with tr denotes the trace and cti — 

and here i 



1 

1 



(^2 



. „ ) ' "'1 ~ ( n 1 )' ^^"^ ^'^'"'^ * ^ \/^l- Using 
this relationship, the equation for antisymmetric part of 
the auxiliary matrix G = D + Q from Eq.(32) is 



QS^ + SQ^ {SD - DS^ 



(33) 



Using the matrix decomposition and the properties of 
Pauli matrices, I obtain 



Q = {SD- DS^)/tr{S) 



(34) 



Note that for the 2x2 matrix M 



Mil M12 
M21 M22 



M- 



22 



-M- 



12 



dct(M) V -^21 Mil 



The ascendant matrix A and the transverse matrix T can 
be found according to Eq.(8): 



T{q) = -Q/dct(G) 



/dct(G) 



(35) 



In two dimensions, dct(G) = dct(_D) + det{Q) — 
D22D11 — DI2 + Q12 a-nd is obviously non-negative. 

To summarize, the computation of quantities in Eq.(3) 
from Eq.(8) is as follows: First, to establish Eq.(8) 
from the artificial life problem, continuous approxima- 
tion should be used. If the problem is given in terms of 
master equation, the usual diffusion approximation will 
be employed, which gives both the diffusion matrix and 
the deterministic drive*. After this is done, the proce- 
dure prescribed in section III. A is employed to find the 



ascendant matrix, the transverse matrix and the fitness 
matrix. According to the artificial life problem, an addi- 
tional approximation may be used to reduce computation 
effort but with the desired accuracy, as done here as well 
as in Zhu et al.^^ for a biological life evolution problem. 



B. Symmetry-Breaking Model 

The symmetric evolution dynamics was explicitly dis- 
cussed by Stewart for speciation^^: 



qt = V0(qt) 



(36) 



This is a deterministic equation. The need for stochastic 
modeling was also mentioned by Stewart. 

In the light of present discussion, the diffusion matrix 
D is equivalent to a diagonal matrix. Hence the fitness 
function can be directly obtained: V'(qt) = 0(qt)- The 
steady state distribution is then given by the Boltzmann- 
Gibbs hke distribution, Eq.(3). All the statistical physics 
methodology can then be applied here. Naturally one 
may make use of the idea of symmetry-breaking as a way 
for self-organization needed for speciation. I refer read- 
ers to the beautiful discussion presented by Stewart^'"'. 
One may even make use of the self-consistent mean-field 
approximation, a powerful mathematical tool in statisti- 
cal physics^'^'', to search for the indication of symmetry- 
breaking. 



V. DISCUSSIONS 

Before further going to further discussion on the impli- 
cation of the present mathematical formulation, it should 
be kept in mind that above three laws must be regarded 
as what the evolution dynamics might be. They are by 
not means the exact description. Having made this state- 
ment, I nevertheless remark that although proposed three 
laws for evolution dynamics are based on the continuous 
approximation, it is possible that main features discussed 
in the present article survive in discrete cases. 

One may ask why to use Eq.(3) and (4) instead of more 
conventional Eq.(8) and (9): After all their equivalence 
has been demonstrated above. Here I offer three reasons 
to favor Eq.(3) and (4): 

1) Quantities presented in Eq.(3) can be directly re- 
lated to experimental observation. For example, Eq.(7) 
gives a direct connection between the fitness function and 
the population density in steady state. By observing the 
dynamical behaviors, information on the ascendant and 
transverse matrices can be obtained. Also, Eq.(7) can re- 
late stability to the fitness function. This direct contact 
with experimental data is an indication of the autonomy 
of the focused level of description. 

2) Eq.(8) and (9) lack the visualizing ability for the 
global dynamics behavior. For example, in a nonlinear 
dynamics with multiple local maxima, it is not clear from 



Eq.(8) and (9) which maximum is the largest one, and 
how easy it might be to mover from one maximum to 
another. One could find this answer by a direct real time 
calculation. But this is usually computationally demand- 
ing, if not impossible. 

3) Eq.(3) and (4) give an alternative modeling of evo- 
lutionary dynamics, which can be advantageous in cer- 
tain situations. For example, the direct use of fitness 
function in Stewart's modeling^^ makes the symmetry- 
breaking idea very transparent from statistical physics' 
point of view. 

One may argue that given the importance of stochas- 
ticity, the present Gaussian white noise assumption may 
not be general enough. This is certainly true. For a cri- 
tique of this sort the present article already serves its 
purpose: It is a starting point. An example is the appar- 
ent more noisy genetic algorithm^*'^^. This is one of most 
successful algorithms to model adaptation and stochas- 
ticity. At a first glance it may not appear to fit into 
present formation: It is difficult to define fitness function 
and stochasticity appears more wild than that expressed 
by Gaussian white noise. However, the very fact that 
there is a selection means a fitness function must ex- 
ist. A coarse grain average in time, that is, over suitable 
large number of generations, a continuous approximation 
in time is still possible. This has been well demonstrated 
in the source of genetic algorithm: The diffusion approx- 
imation in population genetics of biological life evolution 
has been demonstrated to be useful. 

Finally, I point out a unique computational advance 
of the present formulation. For a system has many sta- 
ble fixed points, it is computationally very expensive, if 
possible at all, to find the best stable fixed point from 
the conventional approach represented by Eq.(8). It is 
already difficult enough to compare the relevant stability 
of two stable fixed points according to Eq.(8). For exam- 
ple, it is not possible to compare which Nash equilibrium 
is better in the conventional approach. This compari- 
son is normally not discussed^^. On the other hand, the 
fitness function in (3) directly provides a graphical solu- 
tion to this question: the larger the fitness the better. 
Furthermore, the difference of the fitness peak to the 
nearby saddle point gives a direct measurement of the 
global stability, as expressed by Eq.(7). No a real time 
simulation is needed to find the global evolution trend: 
Given conventional equation Eq.(8), the fitness function 
can be constructed according to Eq.(18). This offers an 
alternative routine for artificial life evolution, certainly a 
tremendous computational edge. 



VI. CONCLUSIONS 

In the present article I have postulated three laws to 
describe the evolutionary dynamics of artificial life with 
four dynamical elements. The most fundamental equa- 
tion, the second law, has been expressed in a unique form 



of stochastic differential equation. The fitness function 
and stochasticity have been emphasized in the present 
formulation. I have demonstrated that present laws are 
consistent with more conventional approaches, but ap- 
pear more suitable to discuss stability and other phe- 
nomena quantitatively. The fitness function is precisely 
defined and is viewed as the standard to make selection. 
The stochasticity is viewed as the source of creativity, 
and its effect is formulated in a transparent relation. The 
present formulation offers an alternative routine to de- 
termine the global evolution trend in addition to direct 
numerical simulation. 
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